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Abstract 

In this paper, we consider the discrete memoryless interference channel with common information, 
in which two senders need deHver not only private messages but also certain common messages to 
their corresponding receivers. We derive an achievable rate region for such a channel by exploiting a 
random coding strategy, namely cascaded superposition coding. We reveal that the derived achievable 
rate region generalizes some important existing results for the interference channels with or without 
common information. Furthermore, we specialize to a class of deterministic interference channels with 
common information, and show that the derived achievable rate region is indeed the capacity region for 
this class of channels. 

Index Terms 

Capacity region, cooperative communications, common information, interference channel, multiple 
access channel, superposition coding, simultaneous decoding. 



I. Introduction 

The interference channel (IC) is one of the fundamental building blocks in communication 
networks, in which the transmissions between each sender and its corresponding receiver (each 
sender-receiver pair) take place simultaneously and interfere with each other. The information- 
theoretic study of such a channel was initiated by Shannon in [1], and has been continued by many 
others [2]-[16] and etc. So far, the capacity region of the general IC remains unknown except 
for some special cases, such as the IC with strong interference (SIC) [3], [6], [9], [10], [12], a 
class of discrete additive degraded ICs [8], and a class of deterministic ICs [11]. Alternatively, 
various achievable rate regions served as inner bounds of the capacity region have been derived 
for the general IC [5], [7], [9], [15]. Notably, Carleial [7] obtained an achievable rate region of the 
discrete memoryless IC by employing a limited form of the general superposition coding scheme 
[17], successive encoding and decoding. Subsequently, Han and Kobayashi [9] established the 
best achievable rate region known till date by applying the simultaneous superposition coding 
scheme consisting of simultaneous encoding and decoding. Indeed, the improvement of the Han- 
Kobayashi region [9] over the Carleial region [7] is primarily due to the use of the simultaneous 
decoding. This has been validated in [15], [16], in which Chong et al. obtained an achievable rate 
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region identical with the Han-Kobayashi region but with a much simplified description, by using 
a hybrid of the successive encoding (same as Carleial's) and simultaneous decoding. Moreover, 
Carleial [7] introduced the notion of the partial cross-observability of each sender's private 
information, which means that each receiver is able to decode part of the private information sent 
from its non-pairing sender. The derivation of the Han-Kobayashi region and Chong-Motani-Garg 
region followed this notion but Chong et al. made an important observation that the decoding 
errors of the crossly observed information can be excluded in computing the probability of error 
[15]. With an introduction of the partial cross-observability, the IC can be viewed as a compound 
channel consisting of two associated multiple access channels (MACs) (strictly speaking, MAC- 
like channels), and thus its achievable rate region can be approached by exploiting existing 
techniques used for MACs. However, the proof of the converse for either achievable rate region 
(Han-Kobayashi region or Chong-Motani-Garg region) is still not available. 

Most of the prior work on the ICs assumes the statistical independence of the source messages 
to be transmitted by the senders [2]-[16]. However, this assumption becomes invalid in an IC 
where the senders need transmit not only the private information but also certain common 
information to their corresponding receivers. Such a scenario is generally modelled as the IC 
with common information (ICC). Marie et al. [18] derived the capacity region of a special case 
of the ICC, the strong interference channel with common information (SICC), and their result 
subsumes the capacity region of the SIC (without common information) [12] as a special case. 
Parallel to the case of the IC, the study of the ICC is closely related to the prior work on the 
MAC with common information (MACC) that has been thoroughly studied by Slepian and Wolf 
in [19] and Willems in [20]. As an example, the capacity region of the SICC shown in [18] can 
be interpreted as an intersection of the capacity regions of two underlying MACC-like channels. 
Moreover, our main results also develop upon interpreting an ICC as a composite channel of 
two MACC-like channels. 

In this paper, we propose a generalized version of the successive superposition encoding, 
namely cascaded superposition encoding, which reduces to Carleial's successive encoding in the 
absence of common information. With this encoding scheme, the senders' common information is 
conveyed through the channel in a cooperative manner. Applying the proposed cascaded encoding 
scheme along with the simultaneous decoding scheme [9], [15], we derive an achievable rate 
region for the general two-user discrete memoryless ICC. The derived achievable rate region 
subsumes the Chong-Motani-Garg region for the general IC as well as the capacity region for 
the SICC as special cases. Moreover, we derive an achievable rate region for a particular class 
of ICCs where one of the two senders has no private information for its corresponding receiver. 
The depiction of the obtained achievable rate region appears very simple with only one auxiliary 
random variable involved. Proving the converse still appears to be a challenge, which we believe 
is as difficult as proving the converse for the Han-Kobayashi region or the Chong-Motani-Garg 
region. 

Lastly, we investigate a class of deterministic interference channels with common information 
(DICCs), which generalizes the class of DICs (without common information) studied in [11]. 
Relying on the crucial assumptions we specified for this class of channels, we show that our 
achievable rate region meets the outer bound of the capacity region, and thus it is actually the 
capacity region of this class channels. This in a certain sense indicates the potential tightness of 
the region as an inner bound of the capacity region of the general discrete memoryless ICC. 

The rest of the paper is organized as follows. In Section 11, we first introduce our channel 
models, including the general ICC and a modified ICC. The modified ICC serves to reveal the 
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information flow through the associated ICC, and facilitates the derivation of the achievable 
rate region for the associated ICC. In Section III, we present the achievable rate region for the 
general discrete memory less ICC in both implicit and explicit forms. We also provide a detailed 
proof of the achievability of the rate region. In Section V, we apply the obtained achievable rate 
region to three special cases of the ICC including the SICC, the general IC (without common 
information), and a class of the ICCs where one of the two senders has no private information to 
transmit. For each case, our achievable rate region either includes the existing results as special 
cases or gives a new achievable rate region. In Section IV, we investigate the class of DICCs 
for which our achievable rate region is in fact the capacity region. The paper is concluded in 
Section VI. 

Notations: Random variables and their realizations are denoted by upper case letters and lower 
case letters respectively, e.g., X and x. Bold fonts are used to indicate vectors, e.g., X and x. 

II. Channel Models and Preliminaries 

A. Discrete Memoryless Interference Channel with Common Information 

A discrete memoryless IC is usually defined by a quintuple {Xi, X2, V, 3^2), where Xt and 
yt, t = 1,2, denote the finite channel input and output alphabets respectively, and V denotes the 
collection of the conditional probabilities p{yi,y2\xi,X2) of the receivers obtaining (2/1,2/2) ^ 
3^1 X 3^2 given that (xi, X2) & Xi x X2 are transmitted. The channel is memoryless in the sense 
that for n channel uses, we have 

n 

P(yi,y2|xi,x2) = Ylpiyii,y2i\xu,x2i), 

1=1 

where = {xa, Xtn) E XI' and yt = {yti, -^ytn) e y't for t = 1,2. The marginal 
distributions of yi and 2/2 are given by 

Pi{yi\xi,X2) = ^ p{yi,y2\xi,X2), 

P2iy2\xi,X2) = ^ p{yi,y2\xi,X2). 

Building upon an IC, we depict an ICC in Fig. [H Sender t, t = 1,2, is to send a private 
message Wt E Ait = {!,..., Mf} together with a common message wo E Aio = {l,...,Mo} 
to its pairing receiver. All the three messages are assumed to be independently and uniformly 
generated over their respective ranges. 

Let C denote the discrete memoryless ICC defined above. An (Mq, Mi, M2, n, Fg) code exists 
for the channel C, if and only if there exist two encoding functions 

fi-.MoxMi^ Xl\ f^.,MoxM2-^ X^, 

and two decoding functions 

91 ■■ y" ^Mox Ml, 92 ■■ 3^2" ^ MqX M2, 
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Fig. 1. The interference channel with common information. 



such that max{P,7,Pg7} < Pe, where P^t, t = 1,2, denotes the average decoding error 
probability of decoder t, and is computed by one of the following: 

PeA = MM M ^ P{{Wo,Wi)t^{Wq,Wi)\{Wq,Wi,W2)), 
= MM M ^ p{,{Wo,W2) ^{Wq,W2)\{Wq,Wi,W2)). 

A non-negative rate triple {Rq, Ri, R2) is achievable for the channel C if for any given < 
Pe < 1, and for any sufficiently large n, there exists a (2"^°, 2"^% 2"^^, n, Fg) code. 

The capacity region for the channel C is defined as the closure of the set of all the achievable 
rate triples, while an achievable rate region for the channel C is a subset of the capacity region. 

B. Modified Interference Channel with Common Information 

To derive an achievable rate region for the ICC, we first need to be clear about the structure 
of the information flow through it. However, this can not be viewed from the original ICC 
model clearly, and thus it is difficult for one to carry out the corresponding information-theoretic 
analysis. To avoid such difficulty, we introduce the modified ICC by following the same approach 
used in [9]. 

The modified ICC inherits the same channel characteristics from its associated ICC, but there 
are five streams of messages to be conveyed through the modified channel instead of three 
through the associated ICC. The five streams of messages no, ni, li, n2 and li are assumed to 
be independently and uniformly generated over the finite sets Ao = {1, A^o}. A/i = {1, A^^i}, 
Ci = {1, Li}, A/'2 = {1, N2}, and C2 = {1, L2}, respectively. 

Denote the modified ICC shown in Fig. Elby the channel Cm- An {Nq, Ni, Li, N2, L2, n, P^) 
code exists for Cm if and only if there exist two encoding functions 

/i : ATo X M X £1 ^ X^, /2 : ATo X ATs X £2 ^ X^, 
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Fig. 2. The modified interference channel with common information. 



and two decoding functions 

<7i:3^r->A/'oxMx/:i, 

,(n) „(n) 



such that maxjPg ^ , Pg 2 } ^ Pe, where the average probabilities of decoding error denoted by 
Pg"^ and Pg 2^ are computed as 



e,l 



1 



P 



in) 



e,2 



N0N1L1N2L2 



N0N1L1N2L2 



p((no,rii,/i) 7^ (no,ni,/i)|(no,ni,/i,n2,/2)), 



nonihn2l2 



^ p((n0,ri2,/2) 7^ ('^0,^2,^2)|('^0,'^1,^1,'^2,^2))- 



nonilin2h 



A non-negative rate quintuple {Rq, R12, Rn, R21, R22) is achievable for the channel if 
for any given < Pg < 1 and any sufficiently large n, there exists a (^2"^", 2"^i2 2"^" , 
2n/?2i^2"^22^^^p^) code for C^. 

Remark 1: It should be noted that compared with Fig. 2 in [9], our modified channel depicted 
in Fig. |2ldoes not include the index 712 (or fii) in the decoded message vector at decoder 1 (or 
decoder 2). This is due to the observation made in [15] that, although receiver 1 (or receiver 
2) attempts to decode the crossly observable private message n2 (or rii), it is not essential to 
include decoding errors of such information in calculating probability of error at the respective 
receiver. This is also the reason why we call the two associated channels of an ICC as MACC-like 
channels instead of MACCs. 

Lemma 1: If {Rq, Ru, Ru, R21, R22) is achievable for the channel Cm, then {Rq, P12+P11, P21- 
P22) is achievable for the associated ICC C. 

Remark 2: Note that with the aid of Lemma [H an achievable rate region for the modified 
ICC can be easily extended to one for the associated ICC. 
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III. General Discrete Memoryless Interference channel with Common 



A. An Achievable Rate Region for the General Discrete Memoryless ICC 

We first introduce three auxiliary random variables Uq, Ui and U2 that are defined over arbitrary 
finite sets Uq, Ui, and U2, respectively. Denote by V* the set of all joint probability distributions 
p{-) that factor as 

p(uo, Ml, U2, xi, X2, yi, 2/2) =p{uo)p{ui\uo)p{u2\uo)p{xi\ui, Uo)p{x2\u2, uo)p{yi, y2\xi,X2). (1) 
Let TZm{p) denote the set of all non-negative rate quintuples (i?o, R12, Rii, R21, R22) such that 



for some fixed joint probability distribution p{-) G V* . Note that each of the mutual information 
terms is computed with respect to the given fixed joint distribution. 

Theorem 1: Any element {Rq, R12, Rn, R21: R22) ^ Tlmip) is achievable for the modified 
ICC Cm for a fixed joint probability distribution p{-) E V* . 

Remark 3: The lengthy proof is relegated to the last subsection of this section. Theorem [T] 
lays a foundation for us to establish an achievable rate region for the general ICC. One can 
interpret this achievable rate region as an intersection between the achievable rate regions of the 
two associated MACC-like channels, i.e., inequalities Q-® depict the achievable rate region 
for one MACC-like channel, and inequalities (fTll- dmi depict the other. 

Theorem 2: The rate region TZ^ is achievable for the channel Cm. with TZm = |Jp(.)eP* ^m(p)- 

Remark 4: Theorem |2l is a direct extension of Theorem [H and the proof is straightforward 
and omitted. Note that the rate region TZ„i, is convex, and therefore no convex hull operation or 
time sharing is necessary. The proof of the convexity is given in the appendix. 

Let us fix a joint distribution p{-) E V*, and denote by TZ{p) the set of all the non-negative 
rate triples {Rq, R2) such that Ri = R12 + Ru and R2 = R21 + R22 for some (i?o, -R12, Rii, 

R2i,R22) eUM- 

Theorem 3: TZ is an achievable rate region for the channel C with 71 = IJ^^.^gp. T^ip)- 
Proof: It suffices to prove that TZ{p) is an achievable rate region for C for any fixed joint 
probability distribution p{-) E V*, while the achievability of any rate triple (i?o, Ri, R2) ^ TZiv) 
follows immediately from Lemma [T] and Theorem [T] ■ 



Information 



i?n</(^i;>^i|f/of/it/2), 

/2i2 + i?ii</(f/i^i;n|W2), 

i?ii + ^2i</(Xi[/2;yi|[/o[/i), 

i?i2 + Rii + i?2i < HU,X,U2; Y,\Uo), 

Ro + R12 + Ru + R21 < /([/of/iXif/2; Fi); 

R22<I{X2;Y2\UoU2Ui), 

R21+R22<I{U2X2;Y2\UoUi), 

R22 + Rl2<HX2U,;Y2\UoU2), 

R21 + R22 + R12 < I{U2X2Ui- Y2\Uo), 

Ro + R21 + R22 + R12 < IiUoU2X2Uu Y2), 



(2) 
(3) 
(4) 
(5) 
(6) 
(7) 
(8) 
(9) 
(10) 
(11) 
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Remark 5: The main idea, as mentioned before, is that we allow the common information (of 
rate Rq) to be cooperatively transmitted by the two senders, on top of which we treat the private 
information at each sender as two parts. One part (of rate R12 or R21) of the private information 
at each sender is crossly observable to the non-pairing receiver, but not the other part (of rate 
Ru or i?22)- However, as discussed earlier, for each of the two receivers, the crossly observed 
information is not required to be decoded correctly. This will be elaborated more clearly in the 
proof of Theorem [T] 

Remark 6: One can observe that the rate of the common information, Rq, is bounded by only 
one inequality at each decoder. This is similar to the case of MACC [19], [20], where the rate 
of the common information is bounded by only one inequality as well. This is due to the perfect 
cooperation of the two senders in transmitting the common information, and the simultaneous 
decoding. Details will also be illustrated in the proof of Theorem [U 

Remark 7: Our achievable rate region for the ICC is possibly a tight one, as we will demon- 
strate in Section IV that our region includes two well-known results as special cases. Moreover, 
in Section V we will show that our achievable rate region meets the outer bound for the capacity 
region of a class of DICCs, which results in the exact capacity region for this class of channels. 

Remark 8: Note that the region TZ is also convex, and one can readily prove it by following 
procedures in the proof of the convexity of TZm. 

B. An Explicit Description of the Achievable Rate Region 

In order to reveal the geometric shape of the region of IZ depicted in Theorem we derive 
an explicit description of the region by applying Fourier- Motzkin eliminations [9], [15], [21]. 

Theorem 4: The rate region IZ is achievable for the channel C with IZ = (Jp^.-jg^. T^{p), where 
7Z{p) denotes the set of all rate triples {Rq, Ri, R2) such that 

Ro<I{UoU^X^U2■,Y,), 

Ro<I{UoU2X2Ui;Y2), 

R,<I{U,X,;Y,\UoU2), 

R2<I{U2X2-MU,U{), 

Ri + R2< I{XiU2; Y,\UoU,) + I{X2Uu Fsl^^o/ys); 

Ri + R2< I{UiX^U2; Y,\Uo) + /(X2; Y2\UoUiU2), 

Ro + R, + R2< IiUoU,X,U2; Y,) + /(X2; Y2\UoU,U2); 

Ri + R2< I{Xi; Yi\UoUiU2) + I{U2X2Ui; Fslf/o), 

Ro + Ri + R2< /(Xi; Yi\UoUiU2) + /(f/of/a^af/i; ^^2); 

2R, + R2< /(t/iXif/2; YM) + /(Xi; Y^\UoU^U2) + /(^a^i; Y2\UoU2), 

Ro + 2i?i + R2< IiUoUiX,U2; Y,) + I{X,; Y^\UoUiU2) + /(^af/i; Y2\UoU2); 

Ri + 2R2 < KU2X2UV, Y2\U^) + /(X2; ^2! Wif/2) + /(^i^2; l^i|t/of/i), 

R0 + R1 + 2R2 < I{UoU2X2U,; Y2) + I{X2; Y2\U^UrU2) + /(Xif/2; Y^\U^U^), 

for some fixed joint distribution p(-) G V* . 

Remark 9: The close relation between the explicit Chong-Motani-Garg region and the capacity 
region of a class of deterministic ICs given in [11] was pointed out in [21]. Similarly, we will 
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disclose that the explicit region for the ICC is also closely related to the capacity region of a 
class of DICCs investigated in Section V. 

C. The Proof of Theorem 

In this section, we will prove Theorem [T] that is the core of this paper up to here. The 
general idea is to apply the cascaded superposition encoding and simultaneous decoding. As the 
following lemma will be frequently used, we state it here before the proof of Theorem [T] 

Lemma 2 ( [22, Theorem 14.2.3]): Let Ae"-* denote the typical set for the probability distri- 
bution p(si, S2, S3), and let 

n 

P{S\ = Si, S2 = S2, S3 = S3) = JJp(sii|s3i)p(s2i|s3i)p(s3i), (12) 

i=l 

then 

Proof of Theorem\l\ [Codebook Generation.] Let us fix a joint distribution p(-) that factors 
in the form of dU). We first generate 2"^° independent codewords uo{i), i E {1, 2"'^"}, 
according to Y[i=iPi^oi)- encoder 1, for each codeword uo(«), generate 2'^^'^'^ independent 
codewords ui{i,j), j E {1, ...2"-^^'^} according to nr=i ^'(^i«l''^oi)- Subsequently, for each pair of 
codewords (uo(z), ui(2, j)), generate 2"^" independent codewords xi(i,j,k), k E {1, ...2"-^"}, 
according to HiLi ^'(^i«l^i«^oi)- Similarly at encoder 2, for each codeword uo{i), generate 2^^^^ 
independent codewords U2{i,l), I E {1, ...2^^^^} according to YYi=i Pi^'^'^l'^oi) ■ Subsequently, 
for each codeword pair (uo(i), U2(z, /)), generate 2"^22 independent codewords X2(z, / , m), m E 
{1, ...2"^22 according to YYi^iPi^'2i\u2iUoi)- The entire codebook consisting of all the code- 
words uo(/), ui(2, j), xi(2, j, k),U2{i,l) and X2(z,/,m) with 2 E {1, 2'^^"}, j E {1, ...,2"^^^^}, 
k E {1, ...,2"^"}, / E {1, ...,2"-^2i} and m E {1, ...,2''^^^} is revealed to both receivers. 

[Encoding & Transmission.] Suppose that the source message vector generated at the two 
senders is {uq, ni,li,n2, 12) = {i, j, k, I, m). Sender 1 transmits codeword xi(z, j, A;) with n chan- 
nel uses, while sender 2 transmits codeword X2(z, /, m) with n channel uses. The transmissions 
are assumed to be perfectly synchronized. 

[Decoding.] Each of the receivers accumulates an n-length channel output sequence, yi 
(receiver 1) or y2 (receiver 2). Let A^f^ denote the typical sets of the respective joint distri- 
butions. Decoder 1 declares that (i,j, k) is received, if {i,j, k) is the unique message vec- 
tor such that (uo(i),Ui(z,j),xi(z,j, A;),U2(z,/),yi) E Ai^^ for some /; otherwise, a decoding 
error is declared. Similarly, decoder 2 looks for a unique message vector {i, I, m) such that 
(uo(i), U2(i, /), X2(z, /, m), ui(i, j), y2) E A^f^ for some j; otherwise, a decoding error is de- 
clared. 

[Analysis of the Probability of Decoding Error.] Because of the symmetry of the codebook 
generation, the probability of error does not depend on which message vector is encoded and 
transmitted. Since the messages are uniformly generated over their respective ranges, the average 
error probability over all the possible messages is equal to the probability of error incurred when 
any message vector is encoded and transmitted. We hence only analyze the probability of decod- 
ing error for decoder 1 in details, since the same analysis can be carried out for decoder 2. Without 
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loss of generality, we assume that a source message vector (tiq, n^, /i, ^2, /2) = (1, 1, 1, 1, 1) is 
encoded and transmitted for the subsequent analysis. We first define the event 

The possible error events can be grouped into two classes: 1) the codewords transmitted are 
not jointly typical, i.e., -Eim happens; 2) there exist some {i,j,k) ^ (1,1,1) such that Eijki 
happens (/ may not be 1). Thus the probability of decoding error at decoder 1 can be expressed 
as 

Pi^ = U U(.,,,fc)^(i,i,i)^«./^-0- (14) 

By applying the union bound, we can upper-bound (fT4ll as 

+ E^(^ii^i)+ E piEiiki)+ E ^(^^.11)+ E ^(^^^1') 

+ E PiE:lkl)+ E PiE^lkl)+ E ^(^lifcl) 

+ E PiEl^kl)+ E PiE^'Jkl)+ E PiE^'Jkl)■ (15) 

Due to the asymptotic equipartition property (AEP) [22], P{EI^t^^) in (fT31) can be made 
arbitrarily small as long as n is sufficiently large. The rest of the fourteen probability terms in 
dTSt can be evaluated through one standard procedure, which is demonstrated as follows. To 
evaluate P(i?jiii), we apply Lemma |2l by letting S'^ = (Uo(i), Ui(2, 1), Xi(i, 1, 1), 1X2(2, 1)), 
S2 = Yi, and S3 = 0, where denotes the empty set. Note that the assumption of the lemma 
on the joint distribution of S'^, S2 and S3 is satisfied, and thus it follows that 

P(^illl) < 2~"(^(^o^i^i^2;n)-6e)^ ^^^-^ 

Since the case with S3 = seems not archetypal, we evaluate one more probability term, 
P{Eijki). Again, we use Lemma |2l by letting S'^ = (Ui(l, j), Xi(l, j, A;)), Sg = Yi, and 
% = (Uo(l),U2(l,l)) to obtain 

P{E,,ki) < 2-"(^(^i^i'^il^o^2)-6^). (17) 

By repeatedly applying Lemma |2l we obtain upper-bounds of the remaining twelve probability 
terms. Further, we employ these bounds to derive an upper-bound of the probability of decoding 
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error at decoder 1 as 

<g + 2"^02-"(^(f^oC/iXiC/2;yi)-6£) _^ 2"'(^o+R2i)2--r'.{I{UoUiXiU2;Yi)-6e) 

2"«i22-"(^{^i'^i;>'i|f^oJ72)-6e) _^ 2'"(^i2+^2l)2-"(^{'^l^lt^2;li|C/o)-6e) 

_^ 2"'Rii2-"(^(^i'"^il^o^i'^2)-6') + 2'"{^ii+^2i)2""(^{^if^2;il|c/oC/i)-6£) 

_^ 2"(^o+^i2)2-"(^('^o'^i'^i^2;yi)-6e) _^ 2"(^o+fli2+-R2i)2-™(^{'^oC/iXi(72;yi)-6e) 

_^ 2"(^o+Rii)2-n(^('^oC/iXiC/2;yi)~6e) _^ 2"(^o+flii+-R2i)2-n(^{C/o;7iXiC/2;yi)-6e) 

_^ 2niRi2+Rii)2~'^iHUiXi;Yi\UoU2)-6e) _^ 2"(^i2+«ii+-R2i)2-"U('^i^i ^2;^! |;7o)~6e) 

_^ 2"(^o+^i2+-Rii)2-"(^(^o^i^i'^2;yi)-6e) _(_ 2n(^?o+-Ri2+Rli+-R2i)2-n(^{C^oC/iXiC/2;Y"i)-6e) ^28) 

It is now easy to check that when inequalities Q-© hold and n is sufficiently large, we have 

PiJ < 15e. (19) 

(n) 

By symmetry, the decoding error probability becomes P^^ ^ 15e for decoder 2, when inequal- 
ities ©-(HI]) hold and n is sufficiently large. It follows that ma.x{P^"^ , P^l^} < 15e, and thus 
any rate quintuple {Rq, R12, Ru, R21, R22) G T^mip) is achievable for the modified ICC Cm. for 
a fixed joint distribution p{-) E V*. ■ 
Remark 10: In what follows, we list a few remarks on the encoding and decoding scheme 
used in our derivation. 

1) We term the above coding scheme "the cascaded superposition coding", because there are 
three layers of code with the bottom one carrying the common information. The 
second layer consists of ui{i,j) and U2{i,l). This layer superimposes the part of each 
sender's private information, which is crossly observable to the non-pairing receiver, on 
the bottom layer; while xi(z, j, k) and X2{i,l,m) form the top layer, and they are generated 
by superimposing the part of private information which is not crossly observable on top 
of both the second layer and the bottom layer. 

2) The encoding scheme is auxiliary random variable efficient in the sense that it only requires 
three auxiliary random variables instead of five required if one follows [9] to apply the 
simultaneous superposition coding scheme. It not only greatly simplifies the description 
of the achievable rate region in terms of the number of inequalities required, but also has 
implications on practical code design or implementation of the system in the sense that 
the number of different codes required is reduced. 

3) For the decoding, the simultaneous joint typicality of three layers of codes is examined. It 
is the reason why we could have to use fourteen inequalities due to (fTSt . but we in fact only 
use five inequalities (inequalities Q-©) instead. Due to the cascaded superpositioning 
and simultaneous decoding, Rq is only bounded together with other rates by ® or dTTT) for 
each decoder. The advantage of the simultaneous decoding over the successive decoding 
is also demonstrated with an example of MACC in [23]. 

IV. Some Special Cases of the ICCs 

A. Strong Interference Channel with Common Information 

We demonstrate that the capacity region of the SICC given in [18] can be obtained as a special 
case of our achievable rate region for the general ICC. 
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Let Vs denote the set of all joint distributions p(uo, Xi, X2, 2/1, 2/2) that factor as p{uq)p{xi\uq) 
p{x2\uQ)p{yi,y2\xi,X2). As defined in [18], an ICC is considered as a SICC if 

/(XijniXsf/o) < /(Xi;y2|X2[/o), (20) 
I{X2;Y2\X^Uo) < I{X2;Yi\XiUo), (21) 

for all joint probability distributions p(-) G Vg. Let TZs{p) denote the set of all non-negative rate 
triples {Rq, Ri, R2) such that 

Ri<IiX^,Y^\X2Uo), (22) 

R2<IiX2;Y2\X,Uo), (23) 

Ri + R2< min{/(XiX2; yi|?7o), /(X2X1; ^21^0)}, (24) 

Ro + Ri + R2< mm{I{X,X2; Fi), /(X2X1; Y2)}, (25) 

for a fixed joint distribution 2j(-) G "Pg. 

Corollary 1 ( [18, Achievability of Theorem 1]): Any rate triple (Rq, Ri, R2) G Cs is achiev- 
able for the SICC with = Up(.)eP. ^^(p)- 

Proof: It suffices to show that TZsip) is achievable for a fixed joint distribution p(-) G Pg. 
Referring to the region defined by (ISll- dTTTl . we set Ui = Xi and U2 = X2, which makes both 
Rii and R22 become zero; and we substitute -R12 with Ri, and i?2i with R2. Hence, inequalities 
©-(inil reduce to 

R,<IiX,-Y,\UoX2), (26) 

R2<I{X2;Yi\UoXi), (27) 

Ri + R2<I{XiXi;Yi\Uo), (28) 

Ro + Ri + R2< I{UoX,X2; Y,)- (29) 

R2<I{X2;Y2\UoXi), (30) 

Ri<I{Xi;Y2\UoX2), (31) 

R2 + Ri<I{X2Xi;Y2\Uo), (32) 

Ro + R2 + Ri< /(f/0^2^1; Y2). (33) 

Since for the SICC inequality (EUt must hold for the given joint distribution, inequality (E^ 
implies (ISTTl . and thus inequality (ISTT) can be excluded. Similarly, inequality (l27t can be excluded 
as well. Due to the fact that Uq, {Xi, X2) and Yt,t = 1,2, form a Markov chain, I{UqXiX2\ Yi) = 
/(X1X2; Yi) and J([/oXiX2; I2) = -^(-^1-^2; ^2)- Hence, 7^s(p) is an achievable rate region for 
the SICC for a fixed joint distribution p(-) G Vs, and is achievable for the SICC. ■ 
Remark 11: By letting Ui = Xi and U2 = X2, we treat the private information at each sender 
as a whole instead of two parts. This differs from what was mentioned earlier in Remark |5l Here 
the full private information at each sender is allowed to be crossly observed by the respective 
non-pairing receivers due to the strong interference. In fact, inequalities also define 

one achievable rate region for the general ICC. However, it is only tight for the case of strong 
interference, but not for the general case. 
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B. Interference Channel without Common Information 

We now consider the general IC (without common information) as a special case of the ICC, 
and demonstrate that our achievable rate region for the ICC subsumes the Chong-Motani-Garg 
region [15] as a special case. Note that the Chong-Motani-Garg region is one of the two best 
achievable rate regions for the IC (without common information), and it has a much simpler 
description of the region compared to the other. 

Let Q denote a time sharing random variable defined over an arbitrary finite alphabet Q, and 
Vo denote the set of all joint distributions that factor as 

Ml, M2, X2, 2/1,1/2) =p{q)p{ui\q)p{u2\q)p{xi\ui, q)p{x2\u2, q)p{yi, y2\xi, X2). (34) 

Let TZo{p) denote the set of all rate pairs R2) with Ri = R12 + Ru and R2 = R21 + R22 
such that 



Proof: It suffices to show that IZoijp) is achievable for a fix joint distribution /?(■) G Vo- 
We still work on the region defined by (ISb- ifTTT) with respect to the general ICC. Since there 
is no common information, we set Uq = 0, and Rq = 0. Note that the existence of Uq in fact 
contributes to the convexity of the rate region TZm, which one can observe from the proof of 
the convexity of TZm in the appendix. When Uq is dropped, we need introduce the time sharing 
random variable Q to maintain the convexity. The rate region defined by (l2b- (fTni now becomes 



Ru<I{Xi;Y,\UiU2Q), 
Ri2 + Rii<I{Xi;Y,\U2Q), 
Rn + R2i<I{XiU2;Yi\UiQ), 
Ri2 + Rii + R2i<I{XiU2;Yi\Q); 

R22<I{X2;Y2\U2UiQ), 
R21 + R22<I{X2;Y2\U,Q), 
R22 + Rl2<I{X2Ui;Y2\U2Q), 
R21 + R22 + Rl2<HX2U,;Y2\Q), 



(35) 
(36) 
(37) 
(38) 
(39) 
(40) 
(41) 
(42) 



for a fixed joint distribution p{-) G Vo- 

Corollary 2 ( [15, Theorem 3]): TZo is an achievable rate region for the IC with 



7^o= U 7^o(p). 



p(-)6Po 



i?n</(Xi;n|f/i^2Q), 



(43) 
(44) 
(45) 
(46) 
(47) 
(48) 
(49) 
(50) 



i?i2 + i?ii </(^iXi;Fi|[/2Q), 
R11 + R21 < I{X^U2-^Y^\U^Q), 



i?i2 + Ru + R21 < I{UiX,U2; FilQ); 

i?22</(^2;l"2|f/2^lQ), 



R21 + R22<I{U2X2;Y2\U,Q), 
R22 + Rl2<I{X2Ui;Y2\U2Q), 



R21 + R22 + R12 < I{U2X2U,; Y2\Q)- 
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According to the joint probability distribution p(-) G Vo, the random variables Ui, Xi and Yi 
form a Markov chain conditioned on U2 and Q, and thus I{UiXi]Yi\U2Q) = I{Xi]Yi\U2Q) 
in (R4l) . Similar simplifications can be made on (l46l) . (l48t and (l50b . Finally, the derived region 
becomes the same as one described by (U51)- (B^ . With Lemma [H we conclude that 7^o(p) is 
achievable for a fix joint distribution G Vo, and IZo is achievable for the IC (without common 
information). ■ 
Remark 12: As shown above, our achievable rate region for the ICC in the implicit form 
subsumes the implicit Chong-Motani-Garg region as a special case. Alternatively, following the 
same procedures as demonstrated in the above proof, we can work on the explicit region given 
in Theorem m to obtain the explicit Chong-Motani-Garg region [15, Theorem 4] as well. 



C. Asymmetric Interference Channel with Common Information 

In this subsection, we investigate a class of the ICCs where one of the two senders does 
not have private information to transmit, and we term this class of channels as the asymmetric 
interference channel with common information (AICC). We present an achievable rate region 
for the AICC as a byproduct of our result for the general ICC. 

Without loss of generality, we assume that sender 1 only has the common message Wq to send 
to receiver 1, while sender 2 needs transmit both the common message Wq and the private message 
W2 to receiver 2. Fig. |3] depicts an AICC, which we denote by Ca- Following the definitions 
and channel models given in Section II, we can easily obtain a corresponding modified channel 
as shown in Fig. lUfor Cq, and we denote it by C™. Note that the capacity region of C™ is a 
set of all achievable rate triples (i?o, -R21, R22)-, whereas the capacity region of Ca is a set of all 
achievable rate pairs (i?o, -^2)- 



Wo 



W2 



Channel 



Encoders 



/i 



/2 



X2(tf0,«'2) 




Decoders 



yi 



9i 



Wo 



y2 



92 



{Wo,W2) 



Fig. 3. The asymmetric interference channel with common information. 



Let Va denote the set of all joint distributions 

p{xi, U2, X2, yi, y2) = p{xi, U2, X2)p{yi, y2\xi, X2), 



(51) 
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Fig. 4. The modified asymmetric interference channel with common information. 



no 



[no, 712,12) 



and let lZ^{p) denote the set of all rate triples {Rq, R21, R22) such that 

i?o + i?2i </(Xit/2;Fi), 

R22<I{X2;Y2\U2X,), 
R21 + R22<I{X2;Y2\X,), 

Ro + R2i + R22<HX,X2;Y2), 



(52) 
(53) 
(54) 

(55) 



for some fixed joint distribution p{-) E Va- 

Corollary 3: TZ"' is an achievable rate region for the modified channel with TZ]^ = 

Up(.).p„7^-(p). 

Remark 13: By setting R12 = and Ru = 0, and substituting both Uo and Ui with Xi, one 
can easily obtain Corollary |3] from Theorem |2l 

By applying Fourier- Motzkin elimination on (l52t - (l55t with R2 = R21 + R22, we obtain an 
explicit achievable rate region for the AICC as follows. 

Theorem 5: TZa = Up( )eP„ T^aip) is an achievable rate region for Ca, where TZaip) is the set 
of all rate pairs (i?o, ^2) such that 

Ro<I{XiU2;Yi), 
R2<I{X2;Y2\X,), 

Ro + R2< mm{I{X^X2; ^2), /(Xit/2; Y,) + /(X2; ^21^/2^1)}, 

for some fixed joint distribution p(-) G Va- 

Remark 14: 1) Alternatively, one can obtain Theorem |5] from Theorem |4l by letting Ri = 
and substituting Uo and Ui with Xi. 2) The coding strategy for this channel remains generally the 
same as the one for the general ICC: both senders first need cooperate to transmit the common 
information; while sender 2 treats the private information as two parts with one part crossly 
observable to receiver 1 but not the other part. 3) Although there is only one auxiliary random 
variable involved, the converse remains extremely difficult to establish. 
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V. The Capacity Region of A Class of Deterministic Interference Channels 

WITH Common Information 

In this section, we investigate a class of discrete memoryless DICCs as depicted in Fig.|5] The 
main characteristics of the channel remain the same as those of an ICC, i.e., source messages 
(^0,^1,1^2), channel input and output alphabets Xt and yt, t = 1,2, encoding functions (/i(-) 
and /2(-)) ^iid decoding functions (gi{ ) and g2i )), existence of codes and achievable rates are 
defined the same as those for the general ICC. The distinction lies on the channel transition, 
which is governed by the following deterministic functions: 

Vt = kt{Xt), t=l,2; (56) 
Yi = oi{X,,V2), (57) 
Y2 = 02{X2,Vi), (58) 

where Vi and V2 represent the interference signals caused by Xi and X2 at the corresponding 
receivers. Furthermore, we assume that there exist two more deterministic functions, V2 = 
hi{Yi,Xi) and Vi = h2{Y2,X2). We denote this class of DICCs by Q. 




Fig. 5. The class of deterministic interference ciiannels with common information. 



Note that the channel defined above is similar to the one investigated in [11], but there is a 
slight difference. In [11], it is required that H{Yi\Xi) = H{V2) and H{Y2\X2) = H{Vi) for 
all product distributions of X1X2. It has also been pointed out in [11] that this requirement is 
equivalent to requiring the existence of V2 = hi{Yi,Xi) and Vi = /i2(^2, -^^2)- Nevertheless, we 
require the latter rather than the former, and in fact the former is not satisfied in our case. We 
will demonstrate that V2 = hi{Yi,Xi) and Vi = /i2(l2,X2) are the actual governing conditions 
for this class of DICCs. 

Let Vd denote the set of all joint distributions p(-) that factor as 

p{vo,Xi,X2) = pivo)p{xi\vo)p{x2\vo), (59) 
where vq is the realization of an auxiliary random variable Vq defined over an arbitrary finite set 
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Vq. Let TZdip) denote the set of all rate triples {Rq, Ri, R2) such that 

< H{Y^), (60) 

< H{Y2), (61) 
Ri < H{Y,\VoV2), (62) 
R2 < H{Y2\VoV^), (63) 
Ri + R2< H{Y^\VoVi) + H{Y2\VoV2y, (64) 
Ri + R2< H{Y^\Vo) + H{Y2\VoV,V2), (65) 
Ro + Ri + R2< H(Yi) + H{Y2\VoViV2y, (66) 
Ri + R2< H{Y,\VoViV2) + H{Y2\Vo), (67) 
Ro + Ri + R2< HiY^\VoV^V2) + //(F2); (68) 
2Ri + R2< H(Yi\Vo) + H(Yi\VoViV2) + //(F2|H^2), (69) 
Ro + 2/?i + i?2 < H{Yi) + i/(Fi|\/o^iV"2) + i/(y2|H^2); (70) 
Ri + 2i?2 < H{Y2\Vo) + //(l2|K)^iV^2) + //(FilFoFi), (71) 
R0 + R1 + 2R2 < H{Y2) + H{Y2\VoViV2) + if (yilH^i), (72) 

for some fixed joint distribution p{-) E Vd- 

Theorem 6: The capacity region of Q is the closure of IJp( )eP '^d{p)- 



Proof: 1) Achievability; It suffices to show that 7ld{p) is achievable for the channel Q 
for a fixed joint distribution p{-) E Vd- As the joint distribution p(-) E Vd does not involve Vi 
and V2, it appears incurring difficulty for us to apply the cascaded superposition coding strategy 
developed for the general ICC to this channel, due to the lack of auxiliary random variables. 
Nevertheless, because the interferences Vi and V2 are determined by the channel inputs Xi and 
X2, we can extend the joint distribution in the form of (l59t to one containing Vi and V2 as 

p{vo,xi,X2,vi,V2) = p{vo)p{xi\vo)p{x2\vo)6{vi - ki{xi))6{v2 - ki{x2)), (73) 

where 5{-) is the Kronecker Delta function. Since Xi and X2 are conditionally independent given 
Vo, the interferences Vi and V2 also become conditionally independent given Vq. Therefore, the 
extended joint distribution (l73l) can be factored as 

p{Vo, Xi,X2, Vi,V2) = p{Vo)piVi\Vo)p{v2\Vo)p{Xi\vi,Vo)p{x2\v2, Vq) , 

and the achievability of the region TZdip) follows readily from Theorem IH 

2) Converse.- It suffices to show that for any (2"-^^°, 2"^% 2"-^2 n, Pe) code with Pe 0, the 

rate triple (i?o, Ri, R2) must satisfy (I60t-(r72b for some joint distribution p{vq)p{xi\vq)p{x2\vq). 
Consider a {T"^ ,T'^\2'^^\n, Pe) code with P^ 0. Note that Pe ^ implies 

and ^ 0- Applying Fano-inequality [22] on decoder 1, we obtain 

H{Wo, Wi\Y^) < n{Ro + Ri)Pl^ + h{Pl^) ^ nei„, (74) 
where h{-) is the binary entropy function, and ei„ — > as P"^^ ^ 0. It easily follows that 

H{W^\Y^, Wo) < H{Wo^ W^\Y^) < nei„. (75) 
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By symmetry, we can also get 

H{W2\Y:^.W^) < H{WM\Y^) < ne2n. (76) 
We now expand the entropy term H{Y^, ^"iVFo, Wi) as 

H{y^\x'^, pvo, Wi) + H{Y^\v:^, xf, w,, w^) 

where (a) follows from the fact that X" = /i(PVo,W^i) is a deterministic function of Wq and 
Wi for a given (2"^"^ 2"^^, 2"^^^ j^, Fg) code; both (b) and (c) are based on the chain rule. Since 
Yi is a deterministic function of Xi and V2, H{Y^\V2 , X"^ ,Wo,Wi) = 0. Similarly, due to 
V2 = hi{Yi, Xi), we have //(^"l^"", ^1", VFo, W^i) = 0. Hence, we obtain the following equality 

H{V2^\X^, Wo, W,) = H{Y,^\Xl Wo, Wi), 

which can be further simplified as follows 

H{V,^\Wo,W,) H{Y{^\Wo,W^), 

HiV^^'lWo) H{Y('\Wo,W,), (77) 

where (a) again follows from the deterministic relation between X^ and (WojW^i)^ and (b) 
follows from the conditional independence between V2 and Wi given Wq. Analogously, we can 
obtain 

H{V^^\Wo) = H{Y^''\WoW2). (78) 

One more pair of crucial inequalities are to be shown before we proceed to the main part of 
the converse. This pair are listed as follows 

IiW,;Y,^\Wo) < IiW,;Y,W,^\V,^Wo), (79) 
I{W2; Y^\Wo) < I{W2; Y^V^\V^Wo). (80) 
Inequality (l79l) can be derived as follows: 

I{W^; Y^\Wo) = H{Wi\Wo) - H{Wi\Y^Wo) 

(a) 

< H{Wi\V^Wo) - HiWilYI'V^Wo) 

< H{Wi\V^Wo) - HiWilYI'V^V^Wo) 
= I{W,;Y('Vr\V2''Wo), 

where (a) follows from the facts that H{Wi\Wo) = H{Wi\V2Wo) which is due to the condi- 
tional independence between Wi and V^" given Wo, and "conditioning reduces entropy", i.e., 
H {Wi\Y{'V2Wo) < H{Wi\Y{'Wo); and (b) follows from "conditioning reduces entropy" as 
well. Similarly, we can obtain dSOb . 

Now we prove each of inequalities d^Ut-dT^ with (r751)-(l5UI). Firstly, inequalities d^Ut and dMT ) 
are obvious. 
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For (l62t . we have 

nRi = H{Wi) = H{Wi\Wo) 

= HiWilWoV^'') 

= I{Wi] I Wo 1^2") + HiWilY^'WoV^) 
< H{Y,^\WoV,^) - H{Y,^\WoW,V,^) + ne.^ 
H{Y{^\WoV,n+ne,^ 

n 

<Y,H{Yu\V2iW^)+nein. (81) 

i=l 

where (a) follows from the fact that Wi and V2 are conditionally independent given Wq\ (b) 
follows from H {Wi\Y{'WqV:^) < H{Wx\Y^Wo) < new, (c) follows from H {Y{'\WoWiV:^) = 
HiY^'lX^V^WoWi) = 0. 

Analogously, for (l63t we have 

n 

ni?2 < Yl H{Y2i\ViiWo) + ne2n. (82) 

i=l 

With respect to (1^ . we have 

n{Ri + R2) 
= H{Wi) + H{W2) 
= H{Wi\Wo) + H{W2\Wo) 

= /(m;niw^o) + ^(t^ilWo) + W;>^2lw^o) + ^(w^2lWo) 

< H{Y^^\Wo) - H{Y,^\WoWi) + H{Y2^\Wo) - H{Y2^\WoW2) + n(ei„ + e2n) 

H{Y{^\Wo) - HiV^^lWo) + H{Y^'\Wo) - HiV.^lWo) + n(ei„ + e2„) 

< H{Y,^V,^\Wo) - H{V,^'\Wo) + HiY^^V^'^lWo) - 1/(^2" I ^0) + n{e,n + e2„) 
= HiY.^lV.^Wo) + HiY^^lV^^Wo) + n(ei„ + e2„) 

n n 

< Y,H{Yi,\VuWo) + Y,H{Y2^\V2^Wo) + n{ein + e2n), (83) 

1=1 i=l 

where (a) follows from inequalities dTSt and (l76t : (b) follows from equalities (TTTb and (l78t . 
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Regarding to (l65t . we have 

n(/2i + R2) = HiW^lWo) + H{W2\Wo) 

< I{W,; Y,^\Wo) + I{W2; Fal^o) + n{e,n + e2n) 

< liWi- Y,"\Wo) + I{W2; Y^^V2^\VrWo) + n{e,n + £2^) 

= I{W,; Y,^\Wo) + I{W2; ^"|V^i"t^o) + HW2; Y,^\VrV2^Wo) + n(ei„ + e2„) 

< HiYI'lWo) - HiY^'lWoW,) + HiV^'lV^Wo) - H{V^\V{'W2Wo) 

+ HiY,^\V,^V2^Wo) - H{Y^\V^V^W2Wo) + n(ei„ + e2„) 

i/(niW^o) + H{Y^\V^V^Wo) + n(ei„ + e2„) 

< 5^ H{Yu\Wo) + J2 H{Y2.\Vi,V2m) + n(ei„ + e2„), (84) 

j=l i=l 

where (a) follows from inequalities STSh and (17^ : (b) follows from inequality dT^ : (c) follows 
from the facts that 1) WqW^i) = H{V^\V{'Wo), 2) H{V^\V{'W2Wo) = due to that 

is determined by which is again determined by {Wo,W2), and 3) /i"(F2"|Vi''^''^2Vl^o) = 
H{Y^\X^V{'V^W2Wo) = 0. 
Similarly, we have 

n n 

n{Ri + R2)<J2 H{Y2.\Wo) + H {Yu\VuV2^Wo) + n(ei„ + e2„), (85) 
1=1 1=1 

which corresponds to (l67t . 
For (l66t . we obtain 

n(i?o + i2i + i?2) 

< liWoWi- Fi") + /(iy2; 1^2lW^o) + n(ei„ + 62.) 

< I{WoWi; Y,^) + I{W2; Y^V:^\y^W^) + n(ei„ + e2„) 

= m^Wv. Y^) + /(t^2; ^2in"W^o) + Y^\V^V^W^) + n(ei„ + €2.) 

< //(Fi") - H{Y^\WqW^) + if(\/2"|Vi'^W^o) - i^(^"|Vi"W2Wo) 

+ H{Y^\V^V^Wo) - H{Y^\V^V^W2W,) + n(ei„ + e2„) 

i/(yi") + H{Y^\V^V:^W,) + n(ei„ + 62.) 

n n 

< 5^ H{Yu) + ^ i/(r2.|^i4^24l^o) + n(ei„ + e2n), (86) 

j = l 4 = 1 

where (a), (b) and (c) follow from the same arguments for (l84l) . Note that the proof for (l86b 
and the one for (15^ only differ in the first few steps, and the rest follows from the same set of 
arguments and procedures. 
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Instead of expressing ra(i?o + -Ri + i?2) as H{WoWi) + H{W2\ Wq), we set n(i?o + ^i + ^2) = 
H {Wq\Wi) + H {W0W2) . Following the similar steps used in deriving (l86t . we can readily obtain 

n n 

n{Ro + Ri + R2)<Y1 ^(^2^) + Yl H{Yu\VuV2^Wo) + n(ei„ + e2„), (87) 

1=1 i=l 

which corresponds to (l68t . 
Now for (1^ . we can get 

n{2Ri + R2) 
= H{Wi\Wo) + H{W,\Wo) + H{W2\Wo) 

< I{W,; ViVTo) + I{Wi; Y,^\Wo) + Y,^\Wo) + n(2ei„ + e2„) 

< I{Wi; Y,^\Wo) + I{Wi; Y,^V,^\V2^Wo) + I{W2; Y^^\Wo) + n(2ei„ + e2n) 
= I{W,; Y,^\Wo) + I{W,; V^^l^a^W^o) + I{Wi; Y{'\V,^V2''Wo) 

+ I{W2;Y,^\Wo) + n{2e,r. + e2n) 
= H{Y^\Wo) - H{Y^^\WoWi) + HiV^'lV^Wo) - H{V^\V^WoWi) 
+ HiYI'lV^V^Wo) - H{Y;'\V;'V^WoWi) + H{Y^\Wo) 
-H{Y^^\WoW2)+n{2ein + e2n) 

H{Y,^\Wo) - H{Y,^\WoW,) + H{Y,^\V('V2^Wo) + H{Y^^\Wo) + n(2ei„ + e2„) 

i^(niiyo) - HiV,^\Wo) + H{Y(^\V,W,^Wo) + H{Y,-\Wo) + n(2ei„ + e2„) 

< H{Y,^\Wo) - H{V2''\Wo) + H{Y,^\V,^V2^Wo) + H{Y,^V2''\Wo) + n(2ei„ + e2„) 
= H{Y,^\Wo) + H{Y,^\V,^V2^Wo) + H{Y,^\V2^Wo) + n(2ei„, + e2„) 

< ^//(ynlM^o) + J2h{Y,,\Vi,V2^Wo) + J2 H {Y2i\V2iWo) + n(2ei„ + e2„), (88) 

i=l i=l i=l 

where (a) follows from inequalities dTSt and (l76l); (b) follows from inequality (l79b : (c) fol- 
lows from the facts that H{V{'\Vi'Wo) = H{V^\Wo) = H(X^\WoW2), HiVI'lV^WoWi) = 
HiV^'lX^V^WoWi) = and HiY^lV^'V^WoWi) = HiY^lV^X'^V^WoWi) = 0; (d) follows 
from H{V2\Wo) = H{Y^\WoWi). Following similar procedures, we can easily obtain 

n n n 

n{Ri + 2R2) < ^ H{Y2^\Wo) + HiY2^\VuV2^Wo) + Y HiYulViWo) 

1=1 i=l 1=1 

+ n{ein + 2e2n), (89) 

n n n 

n{Ro + 2i?i + R2)<Y ^(^1^) + Y H{Y,i\ViiV2iWo) + ^ H{Y2.\V2^Wo) 

i=l i=l 1=1 

+ n(2ei„ + e2n), and (90) 
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n{Ro + Ri + 2R2) < J2 HiY^i) + ^(^2^|^i.^2.H^o) + HiYu\VuW,) 

i=l i=l i=l 

+ n(ei„, + 2e2„), (91) 

which correspond to (TtTTi . (fTOb and ^1% respectively. 

Note that we have derived a number of inequalities (ISTt - dOTT) which, together with (l60b and 
(1611) . upper bound the rate triple (i?o, -Ri, ^2) of the given code for the DICC channel. We now 
adopt the technique which was used to prove the converse of the capacity region of the MACC 
in [19] and [20]. Define Vq = W^, or equivalently V^i = Wq, i.e., or Voi is an auxiliary 
random variable uniformly distributed over the common message set Wo = {1, ■■■,Mq]. Since 
Xi and X2 are conditionally independent given Wq, i.e., p{xii,X2i\wQ) = p{xii\wo)p{x2i\wo), 
we can write 

P{XU, X2i\Voi) = p{xii\Voi)p{x2i\vQi). 

Note that due to the introduction of Vq, the region inherits the convexity from the achievable 
rate region for the general ICC. We can now conclude that as n — > 00 and 0, the rate 

of the given code (Rq, Ri, R2) is bounded by dSUt-dT^ for some choice of joint distribution 
Pi''Jo)pixi\vo)p{x2\vo). This completes the proof of the converse and the theorem. ■ 
Remark 15: 1) As mentioned earlier, our assumption of this class of deterministic channel 
is slightly different from the one given in [11]. We directly require the existence of functions 
V2 = hi{Yi,Xi) and Vi = h2{Y2, X2) such that we have the two equalities //(^"iM^o) = 
HiY^'lWoWi) and HiV-l'lWo) = H{Y^\WoW2). As demonstrated in the above proof, the two 
inequalities are crucial, without which we are not able to establish the converse. Moreover, 
the two equalities in fact reduce to the assumptions made in [11] in the absence of common 
information. Therefore, we can claim that the existence of V2 = hi(Yi,Xi) and Vi = h2(Y2, X2) 
is the more general condition for this class of deterministic interference channels. 2) The capacity 
region of the class of DICCs derived above generalizes the one given in [11]. 

VI. Conclusions 

In this paper, we have investigated the general discrete memoryless interference channel with 
common information, and obtained an achievable rate region for the channel by applying a 
random coding scheme consisting of the generalized successive superposition encoding and 
simultaneous decoding. The achievable rate region is found to be potentially tight, as it not 
only generalizes some important existing results for the interference channel with or without 
common information, i.e., the capacity region of the strong interference channel with common 
information and the Chong-Motani-Garg region (one of the two best achievable rate regions 
for the interference channel without common information) are shown as special cases of our 
achievable rate region; but also is shown to be the exact capacity region for a class of deterministic 
interference channels with common information. Nevertheless, it remains a challenge to establish 
a converse to our achievable rate region for the general discrete memoryless interference channel 
with common information. 

Appendix 
Proof of Convexity TZm 

Let (i?Q, i2j^2 5 -^115 -^21' ^22) ^'^d (-^0' -^12' -^11' -^21' ^22) be two arbitrary rate quintuples 
belonging to TZm- It suffices to show that for given any a E [0, 1], we have {aRl+ (1 — 
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a)Rl, ai?i2 + (1 - ")^12' "^11 + (1 - a^21 + (1 - tt)^21' "^22 + (1 - «)^22) ^ '^m- 

Note that the rate region TZ^ is the union of regions TZmip) over all p(-) G P*. Thus, there must 
exist two sets of auxiliary random variables {Uq, Uj, U2) and {Uq, Uf, ?7|) such that their joint 
distributions pi(-) and p2{-) factor as 

Pi{ul, u\,ul, xi, X2, yi, 2/2) = piul)p{u\\ul)p(ul\ul)p{xi\u\, ul)p{x2\ul, ul)p{yi, y2\xuX2), 
P2{ul, ul, ul, xi, X2, yu 2/2) = piul)p{ul\ul)p{ul\ul)p{xi\ul, ul)p{x2\ul, uDpijji, y2\Xi,X2). 

Let T be the independent random variable, taking the value 1 with probability a and 2 with 
probability \ — a. We define a new set of auxiliary random variables {Uq,Ui,U2) such that 
Uq = {Uq,T), Ul = Ul, and U2 = f/J, and then their joint distribution P3(-) can factor 

P3{uo, Ul, U2, xi, X2, Vi, 2/2) =p{uo)p{ui\uo)p{u2\uo)p{xi\ui, Uo)p{x2\u2, uo)p{yi, y2\xi, X2). 

Since ps{-) G V*, we have TZmiPs) ^ T^m- It is easy to show that {aR^ + (1 — a)Rl,aR\2 + 
(1 - a)Rl2, aR\i + (1 - a)Rli,aRli + (1 - a)Rli,aR\2 + (1 - a)i?i2) ^ 7^^(p3) by following 
the steps used to prove the convexity of the capacity region for the MACC in the Appendix 
A of [20]. Therefore, we conclude that {aRl + (1 - a)Rl,aR\2 + (1 - a)Rl2,aR\i + (1 - 
a)R\i, aR\i + (1 — a)-R2i) ^-^22 + (1 ~ «)-R22) ^ T^miPs) ^ T^m^ which proves the convexity 
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